The Kadison- Singer problem 
in discrepancy theory 

Nik Weaver* 

We give a combinatorial form of the Kadis on- Singer problem, a famous problem 
in C*-algebra. This combinatorial problem, which has several minor variations, 
is a discrepancy question about vectors in C"". Some partial results can be easily 
deduced from known facts in discrepancy theory. 

In its original form, the so-called Kadison- Singer problem [8] asks whether every pure 
state on an atomic maximal abelian self-adjoint subalgebra of B[H) extends uniquely 
to a pure state on B{H), where if is a separable Hilbert space and B{H) is the C*- 
algebra of bounded linear operators on H. It is considered a basic question about the 
most fundamental nonabelian C*-algebra, and has generated a fairly substantial research 
literature. (See [1], [5], and [11] for references.) 

It has been known since [8] that the problem can be reformulated as a question about 
finite complex matrices. Let a diagonal projection be a matrix whose off-diagonal entries 
are zero and whose diagonal entries are each either zero or one. The "paving problem" 
form of the Kadison-Singer problem asks, for each e > 0, to find a natural number r such 
that the following holds: for any complex n x n matrix A whose diagonal is zero, there 
exist n X n diagonal projections Qi, . . . , Qr which sum to the identity matrix, such that 
IIQjAQjII < e\\A\\ for all j. Note that the number r of projections must be independent of 
n. The norm used here is the operator norm for matrices acting on Euclidean space, i.e., 
II A II = sup{||Af||2 : ||f||2 = !}• A short proof of the equivalence of this question with the 
original problem is given in [10]. 

This version of the problem already has a discrepancy-theoretic fiavor, and partial 
results on it were obtained by Bourgain and Tzafriri using probabilistic methods [5]. How- 
ever, we base our approach on a different reduction due to Akemann and Anderson, which 
resembles the above but in which A becomes an orthogonal projection with near-zero 
diagonal. 

A complex n x n matrix P is an orthogonal projection if = P* = In, where 
* denotes Hermitian adjoint and is the n x n identity matrix. For such a matrix 
P = [pij], let S{P) = msiXiPii. Akemann and Anderson [1] considered the conjecture 
that there exist e, 5 > with the following property: for any complex n x n orthogonal 
projection P with d{P) < 5, there is a diagonal projection Q such that HQPQH < 1 — e and 
\\{In — Q)P{In — Q)|| < 1 — £• (As above, || ■ || denotes operator norm.) They showed that 
this conjecture, if true, would imply a positive solution to the Kadison-Singer problem. 
Note that e and S must be independent of n. 
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1. Combinatorial versions of the Kadison-Singer problem 



We now state a more directly combinatorial version of the Kadison-Singer problem. 

Notation. Let ei, . . . , be the canonical orthonormal basis of C'^, let ||f II2 denote the 
Euclidean norm of v e C'^, let Ifc be the k x k identity matrix, and for v E C'' let 
^„ : C'^ — > C'^ be the rank one operator Ay : u ^-^ {u,v)v. (So |(tt,v)p = {AyU,u).) 

For any natural number r > 2 we have the following conjecture. 

Conjecture KS^.. There exist universal constants N >2 and e > such that the following 
holds. Let vi, . . . , v„ e C'^ satisfy ||vj||2 < 1 for all i and suppose 

J2\{u,v,)\'<N 

i 

for every unit vector u E C^. Then there exists a partition Xi, . . . , of {1, . . . , n} such 
that 

Y,\{u.v,)\'<N-e 

ieXj 

for every unit vector u & and all j. 

Note that and e must be independent of n and k. 

Also, observe that for any X C {1, . . . , n} we have < Ylix — ^ ' ^k- Letting A 
be this sum, we have \\A\\ < N and so 



X X 



\{Au,u) - {Au',u')\ < 2N\\ U — U 2 



for any unit vectors u and u'. It follows that the conclusion of KSr really only needs to be 
verified on an e/4A'"-net in the unit sphere of C'^. This remark is due to Nets Katz. 

Theorem 1. The Kadison-Singer problem has a positive solution if and only if Conjecture 
KSr is true for some r > 2. 

Proof. Suppose Conjecture KS^ holds for some r. A?", and e. We claim that for any 
complex nxn orthogonal projection P with 5{P) < 1/N (this notation was defined in the 
introduction) there exist nxn diagonal projections Qi, . . . , Qr which sum to the identity 
and satisfy ||(5j-PQj|| < 1 — e/iV for all j. To see this, let P be a complex nxn orthogonal 
projection with S{P) < 1/N. If P has rank k then its range is a /c- dimensional subspace 
F C C". Define Vi = \/N ■ Pei eV ior 1 < i < n. Observe that 

\\vi\\l = N ■ WPciWl = N{Pei, Si) < N5{P) < 1 
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for all i. Also, for any unit vector u &V we have 



i i i 

Thus, Conjecture KS^ asserts that there exists a partition Xi, . . .,Xr of {1, . . . , n} such 
that 

E \{u,v,)\'<N-e 

for every unit vector u & V and all j. Let Qj be the n x n diagonal projection defined by 

r e, if i e 
^j^i - I if z ^ 

(1 < J < r, 1 < z < n). Then Qi + ■ ■ ■ + Qr = In, and for any unit vector u & V we have 

WQjPuWl = Y^\{QjPu,ei)f = El(^'^<5^-^^)l' 

This shows that HQjPQjll = \\QjP\\^ < 1 - e/N ior all j, as claimed. 

The claim implies a positive solution to the Kadison-Singer problem by a minor mod- 
ification of Propositions 7.6 and 7.7 of [1]. (Those results are stated for the case r = 2, but 
generalize to arbitrary r with the trivial observation that for any ultrafilter W on N and 
any partition Yi, . . . ,Yr of N, we have Yj &U for some j.) Thus, the reverse implication 
holds. 

Conversely, suppose Conjecture KS^ fails for all r. Fix N = r > 2 and let f i, . . . , fn e 
C'^ be a counterexample with e = 1. Let Wi = Vil^~N and observe that = ll'it^illi — 

XjN for all % and A■^u^ < Ik- Then Ik — '^A^i is a positive finite rank operator, so we 
can find positive rank one operators A^. (n + 1 < i <m) such that \\A^. \\ < 1/N for all i 
and Er^w'i = ^k- 

Define an embedding $ : C'^ — > C"^ by ($tt, Cj) = {u, Wi) for 1 < z < m. For any 
tt e C'^ we have 



m 

= El(*«'ei)p = J2\{u,Wi)\'^ = J2{AwiU,u) = \\u\\l 



111 
so $ is isometric. Let P he the orthogonal projection in C""'"'^ with range $(0^^); then 

{Pei,^Wj) = {ei,^Wj) = {wi,Wj) = {^Wi,^Wj) 
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for all i and j, which shows that Pci = since the Wi clearly span C*'. Let D be 
the diagonal matrix with the same diagonal as P, i.e., da = Pa {1 < i < m). Then 

= maxi \\wi\\l < 1/N. 

Let Qi, ■ ■ ■ , Qr be any m x m diagonal projections which sum to the identity matrix. 
Define a partition Xi, . . . , Xr of {1, ... , m} by letting Xj be the diagonal of Qj. According 
to our choice of f i, . . . , f„, we infer that there exists 1 < j < r and u G C'^, ||u||2 = 1, such 
that Y.ieXjn{i,...,n} > N - 1, so that Y^i^Xj > 1 - 1/-^- It follows that 

m 

\\QjP{^u)\\l>J2\{QjPi^^ler)f^Yl K^^'^^)!' 

= ^ \{u,w,)\^>l-l/N 

for this value of j. Thus \\QjPQj\\ = WQjPf > 1 - 1/iV. Finally, the matrix A = P- D 
has zero diagonal and satisfies \\A\\ < 1 + 1/N, and the preceding shows that for any mxm 
diagonal projections Qi, . . . , <5r which sum to the identity we have 

WQjAQjW > WQjPQjW - WQjDQjW >l-2/N 

for some j. Thus, as = r — > cxd, we obtain a sequence of examples which falsify the 
paving problem version of the Kadison-Singer problem given in the introduction. I 

Now we indicate possible modifications in Conjecture KS^ which do not alter its truth- 
value. 

Theorem 2. // either or both of the following modifications is made to Conjecture KSr, 
the resulting conjecture is equivalent to Conjecture KSr'. 

(a) require e = 1; 

(h) assume \ {u^Vi)\'^ = N for every unit vector u instead ofJ2i K'^^? '^^i)!^ ^ 

Proof. If Conjecture KS^ holds for e = 1 then it obviously holds for some e > 0. Conversely, 
suppose it holds for some N and e. Since it remains true for all smaller e, we may assume 
1/e > 1 is an integer. Then scaling the vectors Vi by ^/e shows that it remains true with 
N/e in place of and 1 in place of e (and ||fi||2 < for all i, so certainly for \\vi\\2 < !)• 
Thus, mandating e = 1 does not change the truth of the conjecture. 

Now we consider modification (b). We will show that the truth of Conjecture KS^ for 
some A^ and e is equivalent to its truth with this modification, for the same values of A^ 
and e. By the last paragraph, it follows that also including modification (a) has no effect. 

Conjecture KS^ trivially implies the conjecture with modification (b) for the same 
values of A^ and e. Conversely, suppose the conjecture holds with modification (b), for 
some given values of N and e. Let vi, . . .,Vn G C'^ satisfy 11^1112 < 1 for alH and suppose 
< N for every unit vector u E C''. Then 'Y^Ay^ < N ■ Ik, so the operator 
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N ■ Ik — Ay. is a positive finite rank operator, and just as in the proof of Theorem 1 
we can find positive rank one operators Ay. {n + 1 < i < m) such that ||A^,J| < 1 for all 
i and Ay. = N • 1^. Then the vectors vi, . . . ,Vm satisfy the modified hypotheses of 
the conjecture, so we infer the existence of a partition Xi, . . . , of {1, . . . , m} such that 
YliXj I (^7 ^i) P ^ N — e for every unit vector u & and all j. Letting Yj = n {1, . . . , n}, 
we obtain YliYj I '^i) P ^ ~ ^ for every unit vector u & and all j. We conclude that 
Conjecture KS,- holds for the original vectors vi, . . . , Vn- I 

Conjecture KS^ can also be modified so that the vectors Vi must have unit length, 
though at a significant cost to e. 

Conjecture KS^.'. There exist universal constants N > A and e > -\/iV such that the 
following holds. Let vi, . . . , e C'^ satisfy II2 = 1 for ah i and suppose 

i 

for every unit vector u & C^. Then there exists a partition Xi, . . . , of {1, . . . , n} such 
that 

|(«,^.)|'<iV-e 

for every unit vector u e C'^ and all j. 

Theorem 3. The following are equivalent: a positive solution of the Kadis on- Singer 
problem; the truth of Conjecture KS/ for some r > 2; and the truth of Conjecture KSj.' 
with modification (b) of Theorem 2, for some r > 2. 

Proof. Suppose KS^.' fails for all r. Then we can construct a sequence of matrices A 
which cannot be paved exactly as in the proof of Theorem 1. In this case we obtain that 
\\A\\ < l-\-l/N and for any diagonal projections Qi, . . . ,Qr which sum to the identity we 
have IIQj^Qjll > 1 — 1/y/N — 2/N for some j. This is not as sharp as the conclusion in 
Theorem 1, but it is sufficient to establish a negative solution to the paving problem form 
of the Kadison-Singer problem. Thus a positive solution of the Kadison-Singer problem 
implies the truth of Conjecture KS^' for some r > 2. 

Next, the truth of Conjecture KS^' without modification (b) clearly implies its truth 
with modification (b). 

Finally, assume that Conjecture KS^' holds with modification (b), for some r > 2, 
> 4, and e > We will verify that Conjecture KSr holds for r, N — ^/l^, and e — \fN] 

this is sufficient. (Although N — \fN need not be an integer, this is not a problem; a scaling 
argument as in the first part of the proof of Theorem 2 can then be used to establish the 
truth of KSr for ah integers larger than N — \fN.) 

Let vi, . . . , e C'^ satisfy \\vi\\2 < 1 for all i and suppose J2i I '^i) P < N — y/N 
for every unit vector tt e C'^. Replacing C'^ with span{vj} if necessary, we may assume 
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n > k. Now let m = k + n and define unit vectors Wi {1 < i < n) in. = C'^ © C"' 
by Wi = Vi + \/l — \\vi\\2 Cfc+i- It is clear that \\wi\\2 = 1 for all i. Also define lUn+i for 
1 <i < khy Wn+i = Cfc+j. 

Let Pi and P2 be the orthogonal projections of C"^ onto C'^ and C"' in the decompo- 
sition = C'^ © C"^. For any unit vector u e C"' we have 

111 

n fc 

+ 2ReE^l - ||v^|||(it,^;j)(tt,efe+j) + E|(tt, efc+^ 



Now 



^\{u,Vi)\'^ + - ||'f;i||^)|(w,efe+i)p + ^\{u, ek+ 
11 1 

n n 

< 5^ I (Piti, t;,) P + 2 E I efc+i ) p 
1 1 

|2 , oil n „.ll2 



< (AT - y/N)\\Piu\\i + 2IIP2WII2 < - ViV 
since N > A, and by the Cauchy-Schwarz inequality 



2ReE y 1 - Vi)(M,efc+j) 
1 

< 2 ( J] \{u,v,)\'j - \\v,\\l)\{u, e,+,)'2 

< 2^ N - Vn\\Piu\\2\\P2u\\2 < \/n-Vn. 

Thus, we conclude that K""' <N- VN + \/ N - ^ < N. 

Let B = N ■ Im — YlT -^wi ■ The preceding shows that S is a positive operator, and 
tr(S) = {N — l)m since tr{Ay}J = \\wi\\l = 1 for all i. Let {ft} be an orthonormal basis of 
C"^ which diagonalizes B and say Bft = btft {1 <t < m). Notice that YlT — ^^(-^) = 
(A^ - l)m. Then define unit vectors m, . . . ,Um e by {us, ft) = y/bt/{N - l)me^'''^\ 
We have ^ 

s 

for all 1 < t < m, that is, Ay,^ — B/{N — 1). Thus, letting Wm+i, • • • , WmN consist of 
N — 1 copies of each of the vectors ui, . . . , Um, we have ||wi||2 = 1 for 1 < i < mN and 

mN 



We are now in a position to apply Conjecture KS^' with modification (b). We infer that 
there exists a partition Xi, . . . , of {1, . . . , mN} such that 

J2 An,, <{N- e)Im 

for all j. Letting Yj = fl {1, . . . , n}, we obtain 

J2 <{N- e)h = {{N - \/iV) - (e - %/iV))4 

for all j. We conclude that Conjecture KS^ holds for r, N — y/N, and e — -\/iV, as desired.l 

It is unclear whether the real version of Conjecture KS^ or any of its variants is 
substantially different from the complex version. These variants remain equivalent by the 
same proofs in the real case, with the one possible exception of Conjecture KS^' with 
modification (b), whose preceding equivalence proof does use complex scalars. 



2. Positive results 

We single out the case r = 2 for special attention: 

Conjecture KS2. There exist universal constants N > 2 and e > such that the following 
holds. Let vi, . . . ,Vn G satisfy ||fi||2 < 1 for all i and suppose 

J2\{u,v,)f<N 

i 

for every unit vector u & . Then for some choice of signs we have 



{u,Vi)\'^ 



< N 



for every unit vector tt e C'^. 

Again, and e must be independent of n and k. 

We have altered the statement slightly to conform more closely in style to traditional 
discrepancy statements. Equivalence to the r = 2 case of Conjecture KS^- as stated above 
is an easy exercise. (The value of e changes by a factor of 2.) Conjecture KS2 is equivalent 
to Conjecture 7.1.3 of [1]. 

In this section we present three positive partial results on Conjecture KS2 which follow 
from known general results. For background on discrepancy theory, see [6] or [9] . 



7 



First we observe that a strong form of the conclusion of Conjecture KS2 always holds 
on an orthonormal basis, if not for all unit vectors in C*^. Note that the hypothesis 
^ f j)P < N is not needed for this. 

Proposition 4. Let vi, . . .,Vn £ C'^ satisfy \\vi\\2 < 1 for all i. Then there is a choice of 
signs such that 



i 



< 2 



for all u e {ei, . . . ,6^}. 

Proof. We have '^j\{ej,Vi)\^ = \\vi\\2 < 1 for all i. Thus the vectors ai,...,an G R'^ 
defined by {ai,ej) = |(ej,Vj)|^ satisfy ||ai||i < 1 for all i. It follows from the Beck-Fiala 
theorem [4] that there is a choice of signs such that 



<2, 



i.e., \ J2M(^ii^j)\ ^ 2 for all j. Since = Z)j±(ai,ej), we are done. 



I 



Next, we show that the conclusion of Conjecture KS2 can be achieved for arbitrary 
A?" if e is allowed to depend on n. The result is surprisingly difficult; we prove it using a 
clever theorem on matroid partitions. The same theorem was used to a similar purpose in 

[!]• 

Proposition 5. Let N >2, let vi, . . . ,Vn E satisfy \\vi\\2 < 1 for all i, and suppose 

J2\{u,v,)f<N 



for every unit vector u e C'^. Then there is a choice of signs such that 



< N 



for every unit vector u e C'^. 

Proof. The proof requires the stronger hypothesis \ {u, = N for every unit vector 
u. As in the proofs of Theorems 1 and 2, we can achieve this hypothesis by enlarging the 
set of vectors. Let fi, . . . , (m > n) be an expanded list which satisfies ||fi||2 < 1 for all 
i and YlT — ^ fo^ every unit vector u & . 

The collection of subsets of {f 1, . . . , f^} which are linearly independent in con- 
stitutes a matroid. (See [7] for definitions.) Now for any subset X C {!,..., m} with 
cardinality let V = span{vj : i X} and let d be the dimension of V. Then 



Y,A,^<N.P, 



V 
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where Py is the orthogonal projection onto V, so 



J2tr{A,J<Nd. 

Since YlT ^"^{^Vi) = tr(A'" • //-) = Nk^ combining the preceding with 

^tr(A,J<|X| 

iex 

(since tr(A„.) = ||fi||2 < 1 for all i) yields N{k — d) < \X\. This verifies the hypothesis of 
the Edmonds- Fulkerson theorem ([7], Theorem 2c), and we deduce that {vi, . . . , Vm} can 
be partitioned into two sets (in fact sets, but this does not seem to help matters any) 
Xi and X2, each of which spans C'^. It follows that the quantity Xliex^ K'"''^*)!^ never 
zero as u ranges over all unit vectors in C'^ {j = 1, 2), and therefore X^j^x^ < ^ 

for every unit vector tt e C'^ (j = 1, 2). The same final conclusion obviously holds for sums 
over Yj = Xj (1 {1, . . . , n} {j = 1,2), which is enough. I 

By compactness, the conclusion of Proposition 5 can be strengthened to say that 
I iK-u, < A/" — e for some e > and every unit vector u. The existence of a 

universal e for any fixed value of n then follows by another easy compactness argument. 
(Recall that we can assume k < n.) 

Lastly, we observe that for fixed k the conclusion of conjecture KS2 can be achieved 
with no assumption on ^ \{u, 

Proposition 6. For fixed k, there exists M — M{k) such that the following holds. Let 
vi, . . . ,Vn e C'^ satisfy ||vi||2 < 1 for all i. Then there is a choice of signs such that 



< M 



for every unit vector u G C'^. 



Proof. We use a vector balancing theorem due to Banaszczyk [3]. Let M^"(C) be the 
real vector space of self-adjoint k x k matrics, with Euclidean (Hilbert-Schmidt) norm 
given by \\A\\2 = (tr(A*A))^/^. Define > by the condition that the set of matrices in 
M|"(C) with operator norm at most R has Gaussian measure 1/2. Let K be this set and 
let M = 5R. Also let Bi = ^Ay^ for all i; then ||-Bi||2 < 1/5 for all i and Banaszczyk's 
theorem asserts that there is a choice of signs such that ±Bi e K. It follows that 



and hence 
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so that I '^iM{u.,Vi)\^\ = I J2i^{-^ViU,u) \ < M for every unit vector u e C'^. I 

Oddly, none of the results used in this section rely on probabilistic methods. It seems 
likely that such methods could be used to obtain further results; see [2, Chapter 12]. 
However, we have been unable to do this. 



3. A counterexample 

It is interesting to note that neither Proposition 4 nor Proposition 6 requires the 
assumption ^ | {u, f i) p < N. This suggests replacing KS2 with an even stronger conjecture 
which dispenses with this assumption, and essentially this was done in [1, Conjecture 7.1]. 
However, that version of the conjecture was falsified in [11]. Here we present a sharper 
version of the counterexample which provides better asymptotics. 

Example 7. Let /c > 5 be an integer. Define vectors v'l, . . . , G by 



v'^ = {k — 2)aei — 



\ 



i<j<fe-i 



J 



where a = {k - 1) and (3 = {k ~ 1) Also define Vi = v[l\fb (1 < z < A; - 1) where 
5 = ||^;^||2 = {2k - 2,)/{k - If - 2/k. 

We claim that X] ^ N = 1/5 for every unit vector u & C^. To see this, let 

u e C'^ be a unit vector and write u = ajCj. Then 



fe-i 



{k — 2)aai — aaj + I3ak 
J]((/c-2)V + (/c-2)a2)|a,|2 

i 

+ 2Re (-2(/c - 2)a^ + {k - 3)a^) aidj 

+ 2Re^ ((/c - 2)aP - (k - 2)aP) aiCik + (k - l)/3^\ak\ 

i 



< 1 
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(since A; > 5). All sums in this computation have limits 1 and k — 1. With Vi in place of 
vl the sum is bounded by 1/5, so the claim is proven. 

Now let X be any subset of {1, . . . , A; — 1}, let be its complement, and let c = \X\. 
Since X^j^vK^fe) = Sfc) we have 



ek. 



X 



= 2 



X 



The jth component of Xlx Kr{ek) is Y.x{^k,v'i){v'i,ej)] we have Y.x\'\^k,v'i)? = c/(/c-l) 
and for 1 < J < A; — 1 



if i 



Thus we can estimate 



X 



= (/c - 1 - cya^(3^ + c{k-l- cya^P^ + {c/{k - 1) - 1/2) 

= c(A; - 1 - c){k - l)a^P^ + {c/{k - 1) - 1/2)^ 
= c(A; - 1 - c)/{k - if + {c/{k - 1) - 1/2)2. 



This value is minimized at c = (A; — l)/2, which yields 



^^v'.iek) - \ek 



X 



> 



1 



2Vk^' 



We conclude that for any choice of signs we have 



> 



S^/k^ 



V^/2 ~ y/N/2, 



which implies the same lower bound on | ^ ±|(tt, = \ '^±{Ay.u,u)\ for some unit 

vector u E C'^ which depends on the choice of signs. This completes the example. 



Thus, contrary to the special cases in Propositions 4 and 6, in general if there is no 
restriction on ^ then the quantity | can be arbitrarily large for all 

choices of signs and some u. 

The following definition is standard. For symmetric convex sets U, V in let (3{U, V) 
be the smallest value of R such that for any u\, . . . ,Un eU {n arbitrary) there is a choice 
of signs such that Yl, i'^i ^ • Various classical results take U and V to be P unit balls 
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of for various values of p. For instance, the vector version of the Beck-Fiala theorem 
states that if U is the unit ball and V is the l°° unit ball then /?(£/, V") < 2. 

The questions posed in this paper suggest interest in "noncommutative discrepancy" 
questions where R'^ is replaced with the real fc^-dimensional vector space M^"(C) of self- 
adjoint complex k X k matrics and the P unit ball of R*^ is replaced with the unit ball of 
M^"(C) for the Schatten p-norm defined by 

H|, = (tr|^r)VP 

(where \A\ = {A*A)^/'^) for 1 < p < oo and ||A||oo = ||^|| (operator norm). The operators 
Ay^ in Example 7 then show that the noncommutative analog of the Beck-Fiala theorem 
fails: 

Theorem 8. Let 

U = {Ae M^"(C) : tr|yl| < 1} 

and 

V = {Ae Mr(C) : ll^ll < 1}. 

Then PiU,V) = VL{y/k). 

Obtaining information on the value of I3{U,V) for other norms seems difficult. The 
case where U = V is the unit ball for the Hilbert-Schmidt norm || ■ ||2 is classical, because 
this is a Euclidean norm; we have /3(C/, U) — k. But in all other cases little is obvious 
besides the simple observation that restricting the matrices to be diagonal shows that 
the value of (3 in such a matrix problem is always bounded below by its value in the 
corresponding vector problem. 
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